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A two-parameter family of statistical measures of complexity are introduced based 
on the Tsallis-type nonadditive entropies. This provides a unified framework for the 
study of the recently proposed various measures of complexity as well as for the 
discussion of a whole new class of measures. As a special case, a generalization of the 
measure proposed by Landsberg and his co-workers based on the Tsallis entropy 
indexed by q is discussed in detail and its behavior is illustrated using the logistic map. 
The value of the entropy index, q, with which the maximum of the measure of 
complexity is located at the edge of chaos, is calculated. 
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Given a probability distribution /> = {/>, } 



i=l,2,..., W 



, with W the number of accessible 



states at a certain scale, how can its configurational complexity be quantified? Both the 
completely ordered (CO) and completely random (CR) states are not complex. As 
physical examples, one can bear in mind the states of a perfect crystal and an ideal gas 
as the CO and CR states, respectively. These are rather simple states. Complex states 
exist between the CO and CR states. Therefore it seems natural to impose the condition 
that a statistical measure of complexity, C, if appropriately defined, should vanish at 
both the CO and CR states: 



Obviously there are wide possibilities in specifying such a measure. This shows that the 
notion of complexity is still poorly determined. However, several proposals have been 
made in recent years for quantifying configurational complexity. Landsberg and his co- 
workers [1,2] have introduced a measure of disorder and then described complexity in 
terms of it. (See, also Refs. [3,4].) Using the model of an ideal nonequilibrium Fermi 
gas, they discussed the dependencies of disorder and complexity on temperature. 
Lopez-Ruiz, Mancini and Calbet [5] have suggested instead the product of the 
Boltzmann-Shannon entropy of p and the geometric distance between p and the CR 
state. General properties of this measure have been studied in detail in Ref. [6]. 
Furthermore, in Refs. [7,8], the product of the Boltzmann-Shannon entropy of p and 
the Kullback-Leibler entropy [9] of p with respect to the CR state (chosen as a 
reference state) has been examined. 



C[CO] = C[CR] = 0. 



(1) 
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Thus, different statistical measures of complexity have been proposed and 
independently investigated in the literature. There are however two common features in 
the above approaches. One is that they all use the Boltzmann-Shannon entropy to 
realize the condition C[CO] = 0. The other is that they are nonadditive, i.e., they do 
not possess additivity under replication of the system under consideration. 

Now on the other hand, generalizations of the Boltzmann-Shannon entropy have 
been discussed in the area of nonextensive statistical mechanics. Among others, the 
entropy proposed by Tsallis [10] has been used to formulate generalized 
thermostatistics for analyzing observed phenomena and theories involving (multi)fractal 
structures, long-range interactions and long-time memories [11]. 

Taking into account nonadditive of the previously proposed statistical measures 
[1,2,5,7,8], it is of interest to examine possible roles of nonadditive entropies in 
quantifying configurational complexity. In this paper, we give a unified description of 
those proposed statistical measures of complexity using the Tsallis-type nonadditive 
entropies. We first define a two-parameter family of measures and show that all of them 
belong to this family. Then we consider a single-parameter subfamily that can be 
regarded as a generalization of the measure proposed by Landsberg and his co-workers, 
and study its properties employing the logistic map as a prototype example. We shall 
see how this measure behaves at the critical point of transition from regular to chaotic 
evolutions of the dynamical system. Special attention is paid to the dependence of the 
behavior of the measure on the parameter that characterizes the degree of nonadditivity. 

We start our discussion by recalling the definition of the Tsallis entropy. For a 
probability distribution p - {#} . =1 2 ^ , it is given by 
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i=i 



(2) 



where q is the positive entropic index and k B is the Boltzmann constant which is 
henceforth set equal to unity. Clearly, this quantity converges to the Boltzmann- 
Shannon entropy in the limit q— >1: 

w 

S q [p]^ S ip] = -L Pt**Pr (3) 

S possesses most of basic properties satisfied by the Boltzmann-Shannon entropy, 
such as the //-theorem and concavity. Additivity is however modified as follows: 

S q [p m P i2> ] = S 9 [p m ] + S q [p^] + (1 - q)Sy%[p^]. (4) 

Thus, S is nonadditive unless q—>l. Like all entropies, the Tsallis entropy measures 

randomness. It vanishes for the CO state, in which p i = 1 for a certain i and the other 

probabilities are all zero. The CR state is the maximum Tsallis entropy state. It is the 
equiprobability state 

p*=l/W (i = l,2,...,W). (5) 

In this case, the Tsallis entropy is calculated to be 



4 



s q [p eq ] = sp=^-(w^-i), 



(6) 



which tends to the celebrated Boltzmann formula S eq = In W in the limit q — > 1. 

Next we quantify the difference between the configuration p and the CR state. For 
this purpose, we propose to use the generalized Kullback-Leibler entropy [12-14] 

i w 

where p' is the reference probability distribution. This quantity converges to the 
ordinary Kullback-Leibler entropy in the limit q — > 1: 



w 

K q [p,p']^>K[p,p'] = t, Pi Xn ->- ( g ) 



K q [p, p'] is positive semi-definite and is zero if and only if p-p'. Therefore it 
measures the difference between p and p' . It can be shown that analogously to Eq. 
(4) K q satisfies the following pseudo-additivity relation: 

K q [ P m p' 2 \ p w p (2) ] = K q [p il \ P + K q [ P {2 \ P (2) ] 

-(\-q)K q [p {V \p' W }K q [p^\p'^\ (9) 
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Generalizing the ideas proposed in Refs. [3,7,8], we now consider the following 
statistical measure of complexity: 



Cjp] = S q [p].K q ,[p,p^], 



(10) 



where the equiprobability distribution (the CR state) is chosen as the reference state. It 
is obvious that this quantity satisfies Eq. (1). At this stage, q and q are taken to be 
different for the sake of generality. So, Eq. (10) defines a two-parameter family of 
measures. Since the second factor on the right-hand side of the above equation is 



Let us consider some limiting cases of C q , and see how the measures proposed in 

Refs. [1,2,5,7,8] are reproduced. First of all, recall that the measure given in Refs. [7,8] 
is the product of the Boltzmann-Shannon entropy and the ordinary Kullback-Leibler 
entropy with the equiprobability reference state. Therefore, clearly it is obtained in the 
limits q,q'—$\; 




(ID 



with Sp given in Eq. (6), Eq. (10) can also be written as 




(12) 




(13) 



6 



where S eq = In W. In terms of Landsberg's disorder [1] 



(14) 



C y [ is written as 



C 1A [p] = {S-) 2 A[p](l-A[p]). 



(15) 



Up to the constant prefactor (S eq ) 2 , this quantity is equivalent to the measure of 
complexity proposed in Ref. [2] 



rb]=AH(i-A[ P ]). 



(16) 



Secondly, let us consider the limits q — > 1, q — > 2 . In this case, Eq. (11) becomes 



r w i 

K q \p,p^K 2 [p,p^] = W £ W 2 -- 

= WE A- 



! = 1 



-V 



(17) 



The summation in this equation is the squared geometric distance between p and p eq . 
Therefore, in these limits, we have 
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W / i \2 

C q Jp]^C l2 [p] = WS[p]^[ Pi --\ . (18) 



Up to the constant prefactor W , this is equivalent to the measure proposed by Lopez- 
Ruiz, Mancini and Calbet in Ref. [5]. Thus we observe that all the proposed statistical 
measures of complexity mentioned here are unified in the present two-parameter family 

Moreover, it is of interest to consider a single-parameter subfamily, in which q-q . 
In this case, Eq. (10) becomes 

C q , q [p] = W^(sp)\[p], (19) 



where 



r,[p] = A,W(l-A,W). (20) 



A ? and Y q are the ^-generalizations of Eqs. (14) and (16), respectively. Clearly, the 
maximum of Y q is given by 
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r max =r(A =1/2) = -. 

1 ?v 1 '4 



(22) 



The maximization condition A = 1 / 2 , that is, 

S q [p] = \s? (23) 

should fix the value of q = q*. 

This enables us finally to locate the maximum of complexity at the edge of chaos. In 
what follows, we study the behavior of C employing the logistic map as a prototype 

example. We examine several values of q . We shall numerically determine the value 
of q , with which the maximum value, C ™ x , is located at the point of transition from 
regular to chaotic evolutions. Note that C™ x monotonically increases with respect to 
W. 

So, let us consider the logistic map in the following representation [15]: 

x n+1 = l-axt, (24) 

where a e [0, 2] is the control parameter and jc n e[-l, l] (n = 0, 1, 2, ...). Following 
standard procedures in symbolic dynamics [15], we have translated each orbit 
(xj, x 2 , x 3 , ...) of the map into a binary sequence of 0's and l's, according to the rule: 

if x < and 1 if x>0. As was done in Refs. [5,6], sequences of length 12 are 
regarded as the states of the system. That is, each string of 12 symbols is regarded as 
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one possible state. The present measure of complexity has been evaluated on a 
probability distribution associated with this space of 2 12 states. In order to find the 
concomitant probabilities, p, (i = 1, 2, 2 12 ), we have iterated the map 12x10 6 

times, thus generating 10 6 (non-overlapping) sequences of length 12. The probability, 
p ; , associated with the zth state is, after proper normalization, proportional to n ( ., 

which is the number of times of appearance of the zth state during the iteration of the 
map. Thus, the probability, p ; , measures how often that particular string of 12 symbols 

is "visited" during time evolution of the system. We have computed the value of q at 
the critical point, at which the measure C q in Eq. (19) takes its maximum value; that 
is, the value of q, for which the quantity, A , is equal to 1/2. We have considered 

the critical point associated with the onset of chaos after the period doubling sequence. 
Such a critical value of the map parameter is given by [15] 



In Fig. 1, we present plot of p i at a = a c . We have numerically calculated the 
associated optimal value of the parameter, q - q *. It is found to be given by 



The present measure with this value of the index of nonadditivity can be thought of as 
an extreme improvement of the measures of complexity introduced in Refs. [3-5,7,8], 
since it takes its maximum value at the edge of chaos. 



a c = 1.401155189.... 



(25) 



q* = 1.433601669.... 



(26) 
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In Fig. 2, we present the plot of C gt ». Its maximum at a c is clearly appreciated. (It 
is interesting to observe that C gt » takes its maximum also for the values of a different 
from a e . We hope to analyze this point elsewhere.) For comparison, we also present 
the plot of C u , which is essentially the measure given in Refs. [1,2]. Clearly, C u 

does not take its maximum at the edge of chaos. 

In conclusion, we have proposed a unified description of configurational complexity 
based on a two-parameter family of statistical measures, which are essentially 
nonadditive. In particular, we have studied in detail a peculiar one-parameter sub- 
family of measures indexed by q, which is a generalization of the measure introduced 
in Refs. [1,2]. We have examined it for the logistic map as a prototype example and 
have determined the associated value of the index, q. Further applications of the 
present measure to other dynamical systems are welcome. 

Note added. In their recent paper [16], Piasecki, Martin and Plastino have made use of 
the Tsallis entropy to quantify inhomogeneity and complexity of spatial patterns. Also, 
one of us (T. Y.) has recently examined the use of generalized entropies for measuring 
statistical complexity [17]. However, the scopes of these works are different from the 
present one. 
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Figure Captions 

Fig. 1 The probability distribution with 2 12 states of the logistic map at the critical 
point a c . Iteration of 12 x 10 6 times is performed, generating 10 6 sequences 
of length 12. The initial condition is taken to be x = 0.45 . All quantities are 
dimensionless. 

Fig. 2 The plot of the measure C gt . » with q * , fixed by the condition in Eq. (23), 

calculated by using the distribution in Fig. 1. All quantities are dimensionless. 
Fig. 3 The plot of C u with respect to a. All quantities are dimensionless. 
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